What is visual servo?

Visual Servoing is a method of controlling the motion of a robot or other type of machine based on visual feedback from a camera or other sensor. This approach allows a machine to follow a desired trajectory or perform a specific task, such as grasping an object, without relying on pre-programmed data.

In visual servoing, an algorithm is used to analyze the images from the camera, and determine information such as the distance and orientation of the object of interest. This information is then used to calculate the required motion of the machine. The feedback loop between the camera and the machine ensures that the machine's motion matches the desired trajectory.

There are two main types of visual servoing: pose-based and image-based. Pose-based methods rely on the detection of specific features or landmarks on the object being manipulated, while image-based methods use overall visual information to guide the motion of the machine.

Visual servoing is commonly used in robotics applications such as assembly, welding, and painting, and has also been applied in fields such as biology and medicine where precise manipulation is required.